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ABSTRACT 

Student beliefs about assessment may vary according to the level of schooling. The Students 
Conceptions of Assessment version 6 (SCoA-VI) inventory elicits attitudes towards four 
beliefs (assessment: improves teaching and learning, measures external factors, has affective 
impact/benefit, is irrelevant). Using multi-group confirmatory factor analysis, responses of 
primary (h= 100) and high school students («=134) revealed statistically significant mean 
score differences. The older students agreed less with improvement, affect/benefit, and 
external factors conceptions and more with the irrelevance conception. This study provides 
further evidence that student beliefs about assessment are consistent with how assessment is 
used in their school environments. 


INTRODUCTION 


Teacher and student beliefs or conceptualisations of educational processes (e.g., teaching, 
learning, and assessment) have been shown to significantly predict practices and outcomes across a 
range of learning domains (Clark & Peterson, 1986; Richardson, 1996; Thompson, 1992). As self¬ 
regulation improves student academic outcomes (Boekaerts & Cascallar, 2006; Pintrich & Zusho, 
2002; Zimmerman, 2008), it is important to understand beliefs which may facilitate or thwart self¬ 
regulation behaviours. To be self-regulated learners within a school context, students often need to 
utilise feedback obtained from educational assessments. To use such feedback effectively, they must 
have a personally meaningful purpose for assessment (e.g., it functions as an evaluation of my work), 
exercise effective skills and strategies in preparing for these assessments, and be able to regulate 
emotional, cognitive, and behavioural responses once the assessment is finished (Zimmerman, 2008). 
Therefore, what students think about the nature of assessment, their roles, and the purposes of the 
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assessment is likely to affect how they respond to and participate in these practices, also influencing 
their ability and desire to be self-regulated learners. 

To better understand the relationship between people’s beliefs and behaviours, this study drew on 
Ajzen’s (Ajzen, 1991; Ajzen & Madden, 1986) theoretical framework which suggests that people’s 
beliefs are among the predictors of behaviour. Ajzen’s (2005) framework identifies that beliefs people 
have about a phenomenon, their sense of control or agency within that phenomenon, and their 
understanding of the social norms towards a phenomenon are key determinants of a person’s 
intentions, purposes, or goals. Consequently, such attitudes are significant contributors to behavioural 
choices. Hence, human responses to educational processes, such as assessment, depend primarily on 
their appreciation of what the process is and what it is aimed at achieving. 

It is also important to remember that beliefs do not exist within a vacuum; there will always be 
pressure for beliefs to be rational or coherent within the person’s environment (that is, ecological 
rationality) (Rieskamp & Reimer, 2007). Beliefs about a phenomenon tend to differ according to the 
environmental constraints imposed on the phenomenon. For example, studies into teacher conceptions 
of assessment have found different patterns of association between assessment for improved learning 
and assessment for school accountability in differing regions of the world. Among teachers in Hong 
Kong and China there was a strong correlation (r >.70) between accountability and improvement 
(Brown, Kennedy, Fok, Chan, & Yu, 2009; Brown, Hui, Yu, & Kennedy, 2011; Li & Hui, 2007), 
whereas, the correlations were only weakly positive (r <.30) for New Zealand and Queensland, 
Australia teachers (Brown, 2004b, 2011; Brown, Lake, & Matters, 2011). These differing correlations 
likely reflect real world differences between the assessment systems in these regions (that is, high- 
stakes testing environment versus primarily lower-stakes classroom assessment environment). For 
example, if you work within a high-stakes testing environment, it may be ecologically rational to 
adopt the view that this level of accountability does improve student learning in order to remain 
personally motivated to prepare students for these exams. 

Even small differences within New Zealand and Queensland policy contexts between primary 
and secondary levels of schooling (for example, student achievement is certified in secondary but not 
primary school) have generated significant differences in mean scores between primary and secondary 
teachers concerning the nature of assessment (Brown, Lake, & Matters, 2011). Hence, it would be 
expected that primary and secondary school students themselves would have significantly different 
understandings of assessment because of the differing consequences attached to it; while doing poorly 
on assessment in primary school has limited consequences, in secondary school, it may limit one’s 
access to tertiary education and some employment opportunities. 

The study reported in this paper shares the results of a New Zealand study that investigated 
students’ conceptions of assessment, comparing and contrasting data from students in upper primary, 
intermediate, and secondary schooling. It will first review existing research on student beliefs about 
assessment before explaining the New Zealand context for this study and sharing the study’s design, 
results, and implications. 

Student beliefs about assessment 

There is a relatively limited body of research relating to student conceptions of assessment. 
Previous international studies indicate that, while students begin school feeling positive about 
assessment, negativity increases as they continue their education, demonstrating that assessment can 
inspire strong affective responses in students. Moni, van Kraayenoord, & Baker (2002) found that 
Australian students in their first year of high school became increasingly negative towards literacy 
assessments and suggested that this attitudinal shift was due to increases in the volume and difficulty 
of assessment, alongside perceptions that teacher assessment decisions were subjective. 

Student negativity may also increase because students become more aware of the personal 
consequences of assessment. Wheelock, Bebell, and Haney’s (2000a, 2000b) analysis of grade 4, 8, 
and 10 students’ drawings of their experiences of Massachusetts Comprehensive Assessment System 
testing found older students were three times more likely to draw negative pictures than younger ones; 
they hypothesised this was due in part to increased awareness of the personal implications of their test 
results (i.e., tracking, retention, graduation). Similarly, pictures of assessment drawn by New Zealand 
high school students were more emotive and negative than those from primary and intermediate 
pupils (Harris, Harnett, & Brown, 2009). The United Kingdom’s Assessment Reform Group (2002) 
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also found that older students (11 years or older) were more aware of the meaning and consequences 
of grades, had increased perceptions that teacher grading was unfair. Further, they reported that 
students older than 11 were more likely to attribute good results to their own ability and effort, while 
they found younger students tended to attribute performance to external factors (e.g., quality of 
school/teacher; luck; the teacher likes me; etc.) or practice. As Rotter (1982) has shown, success 
attribution in external, uncontrollable factors is associated with reduced academic achievement; 
whereas, endorsement of internally-located, consistent, and controllable causes is associated with 
increased performance. 

However, it is possible that this increased student negativity is not entirely due to the higher 
consequences of assessment in secondary school. Brookhart and Bronowicz’s (2003) study of 
American primary and high school students suggested that while high school students appeared to 
cease ‘liking’ assessment like the primary students, these older students did report appreciating of the 
importance of these tasks. They hypothesised that ‘liking’ may moiph into an appreciation of the 
importance of a task; while students may no longer consider assessment to be enjoyable, it may still 
be seen as a valued activity. Thus, it would appear that, by high school, students have a complex set of 
beliefs concerning assessment: their emotional stance seems relatively negative, perhaps because of 
its frequency and importance for life chances, their attributions for success tend to be internally 
located, and yet assessment is important to them, perhaps because of the opportunity to improve their 
achievement and proficiency embedded in the feedback system (Butler & Winne, 1995; Hattie & 
Timperley, 2007). 

Together, these studies appear to identify a trend; while students appear initially to accept and 
perhaps enjoy assessment, student attitudes become more negative as they progress through school, 
become more aware of the consequences of assessment, and experience higher-stakes assessment 
practices. In addition to affective response towards assessment, students also have at least four major 
beliefs about the purposes and nature of assessment (see reviews in Brown & Hirschfeld, 2008; 

Harris, Harnett, & Brown, 2009). These beliefs included: (1) ‘improvement’: assessment improves the 
teacher’s teaching and the student’s learning; (2) ‘external attribution’: assessment serves external 
puiposes such as judging a school’s quality or predicting students’ future educational and employment 
success; (3) ‘affective benefit’: assessment is enjoyable and helps classmates be more supportive of 
each other; and (4) ‘irrelevance’: assessment is irrelevant because it is unfair and ignored. Research 
using the Student Conceptions of Assessment (SCoA) inventory in New Zealand has shown that the 
‘improvement’ conception has an adaptive effect on standardised test performance in mathematics 
(Brown & Hirschfeld, 2007; Brown, Peterson, & Irving, 2009) and reading (Brown & Hirschfeld, 
2008), and is a belief system aligned with self-regulation theories (e.g., Boekaerts & Corno, 2005; 
Zimmerman, 2008). In other words, increased endorsement of the ‘improvement’ conception predicts 
increased academic performance. In contrast, the more students endorsed the conceptions of ‘external 
attribution’ and ‘irrelevance’ the lower their achievement scores were in both studies. The ‘affective 
benefit’ factor (that is, a form of personal well-being emphasis) was inversely related to performance 
on a standardised mathematics test (Brown, Peterson, & Irving, 2009). The proportion of variance 
attributed to these factors on one-off tests of academic performance has been moderate (SMC ranged 
from .13 to .25), indicating that student beliefs about the nature of assessment do matter for individual 
student academic achievement. 

Assessment in New Zealand 

To understand the results of the study reported in this paper, it is important to know about the 
assessment context within New Zealand. Large structural changes have been initiated in New Zealand 
schooling and education over most of the last three decades (Fiske & Ladd, 2000; Levin, 2001). The 
national assessment policy in the compulsory school sector (ages 6 to 16) emphasises voluntary, 
school-based assessment for the purposes of raising achievement and improving the quality of 
teaching programmes (Ministry of Education, 1994, 2007) relative to the outcomes specified in the 
national curriculum. The curriculum is child centred, non-prescriptive, holistic, and integrated, but 
does have specified outcomes and objectives of progression organised into eight levels of 
performance covering Years 1 to 13 (ages 5-18). There is no compulsory, state mandated assessment 
regime in the primary school sector (i.e., Years 1-8). All assessment practices in the first ten years of 
schooling (that is, primary, intermediate, and the first two years of high school) are voluntary and low 
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stakes. Primary school teachers make extensive use of informal assessments and standardised tests 
(Crooks, 2002), primarily for the purpose of improving instruction and student learning (Croft, 
Strafford, & Mapa, 2000; Hill, 2000). 

New Zealand subscribes to an Assessment for Learning approach (Ministry of Education, 2010), 
even among secondary schools. Given this approach, students could be expected to be participating in 
a range of student led assessment practices (e.g., peer and self-assessment), along with standardised 
measures. Hence, the general culture of school assessment is largely focused on improved teaching 
and learning, with classroom assessment playing a major role. 

However, the national assessment policy has a strong public accountability element. Even 
primary schools are expected to demonstrate (to parents) that student performance is improving 
relative to the curriculum levels and objectives. Secondary schooling, however, has a high-stakes, 
student qualifications system (that is,, the National Certificate of Educational Achievement, NCEA) 
which begins formally in the third year of secondary schooling when students are about age 15 
(Crooks, 2010). The system is composed of both internally and externally assessed items, including 
tasks which are not ‘tests’ per se (for example, projects, reports) which are marked using standardised 
criteria. This means that teachers are actively involved in administering, evaluating, and judging 
student performance through internal assessments and must also prepare students for end-of-year 
external examinations. Furthermore, there seems to be a wash-back effect of the national qualification 
system upon how assessment practices are implemented in the early years of high school. Assessment 
practices in the first two years of high school (Grades 9 and 10) are officially supposed to be school- 
based measures used to help students improve learning and report on their progress. However, there is 
strong evidence that teachers are using NCEA grading systems in those grades as preparation for the 
official NCEA system (Bashford, 2007; Mizutani, 2006; Rae, 2007). 

Hence, one would expect that the impact of assessment on teacher and student beliefs would 
become more focused on the accountability and external purposes as students transition from a 
primary to high school. Indeed, New Zealand secondary teachers agreed the conception that 
assessment makes students accountable much more than primary teachers (Brown, 2011). Likewise, 
among Year 12 high school students, after their first experience with the qualifications system in Year 
11, the relationship between endorsement of student accountability as a purpose for assessment and 
performance on a standardised test was much stronger than it was for younger students who had not 
yet experienced the qualifications system (Hirschfeld & Brown, 2009). Thus, it seems likely, then, 
that students in New Zealand would be committed to the notion of assessment for improved learning 
and teaching in the primary schooling years, but in secondary schooling students may endorse more 
strongly the conception that assessment serves certification. 

METHOD 

The study reported in this paper aimed to expand the usage of the Student Conceptions of 
Assessment (SCOA) inventory to include younger New Zealand students (primary and intermediate 
school students) using a non-experimental survey design. The following hypotheses were proposed: 

1. It was expected that the measurement model of the SCoA would be sufficient to 
explain the responses of the primary and intermediate aged students. 

2. Because of the essentially formative nature of assessment in New Zealand, it was 
deemed likely that students across year levels would endorse most strongly the conception 
that assessment serves to improve student learning. 

3. It was hypothesised that younger students would have higher mean scores for 
improvement than high school students as a consequence of the primary school assessment 
environment. 

4. Although all assessment in New Zealand is intended to be low-stakes until Years 11- 
13, it was expected, because of wash-back effects, that high school students in Years 9 and 10 
would have a stronger endorsement of student conceptions of assessment as a means of 
accountability than primary school students. 
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Table 1 . Demographic characteristics of students according to school level. 


Demographic 

School Level 
Primary Intermediate 

High School 

Sex 

Female 

17 

18 

64 

Male 

32 

33 

70 

Ethnicity 

New Zealand European 

42 

23 

73 

Maori 

3 

2 

46 

Pasifika (Pacific Ocean island nations) 

1 

9 

4 

Asian 

2 

17 

11 

Grade 

5 

10 



6 

29 

— 

— 

7 

9 

25 

— 

8 

— 

26 

— 

9 

— 

— 

47 

10 

— 

— 

87 

Mean Age ( SD ) 

10 

11.94 

14.27 


.42 

(.84) 

(.65) 

School Socio-Economic Status 

High (Deciles 8-10) 

(.66) 

27 

22 

71 

Medium (Deciles 4-7) 

22 

29 

23 

Low (Deciles 1-3) 

0 

0 

40 

Total 

49 

51 

134 


Participants 

Students were recruited through teachers who participated in Studies 1 and 2 of the Measuring 
Teachers’ Assessment Practices (MTAP) project. This project looked at teacher and student 
conceptions and practices of assessment, focusing on Years 5-10. In all, nine teachers who were 
already participating in the study agreed to approach students in one or more of their class groups and 
invite them to participate. To participate, students had to obtain signed parental consent and provide 
their own written consent in accordance with The University of Auckland Human Participants Ethics 
Committee approval #2008/053. In all, 347 questionnaires were sent out to teachers for distribution 
and 234 were returned, comprising a 67% return rate (primary 77=49, intermediate n= 51, secondary 
77=134). Responses came from students in Years 6-10. There was some overlap between the ages of 
the primary and intermediate students as two of the sampled primary classes were composite Year 6/7 
classes from full primary schools (that is, schools which cater for students in Years 1-8), while 
intermediate student questionnaires were from students in Years 7 and 8. 

Demographic details of the sample (Table 1) show considerable differences by school level. The 
proportion of males to females was much higher in the primary and intermediate groups 
(approximately 2:1), whereas it was nearly equal in the high school group. The majority of students 
were New Zealand European ethnicity, which accords with New Zealand census statistics. However, 
the proportion of Maori students across the levels was quite distorted. There are between 15-20% 
Maori in the New Zealand population, but the indigenous group were underrepresented in the two 
lower levels and significantly over-represented in the high school group. This latter result was a 
consequence of one participating school having a high percentage of Maori students. The grade 
distribution followed the normal expected pattern of Primary (Grades 1-6), Intermediate (Grades 7-8), 
and High School (Grades 9-13). Only nine students in the Primary sample were in Grade 7. This 
indicates that inferences that can be made about school level fundamentally reflect the appropriate 
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grade distributions. Consistent with this distribution was the mean age of students in each school 
level, with mean scores ranging from about IOV 2 to 14. 

New Zealand schools are classified by the Ministry of Education according to the socio¬ 
economic resources of families whose children attend each school. A ten-point scale (deciles) is used, 
with each decile containing l/10 th of the population. It is common to aggregate deciles 1-3 as low 
socio-economic status (SES), deciles 4-7 as medium, and deciles 8-10 as high. The most notable 
feature of the distribution is the absence of low socio-economic schools in the Primary and 
Intermediate groups, whereas the High School group more closely reflected the New Zealand 
population with 29% in the low SES categorisation. 

Instrument 

Student beliefs were elicited from self-reported responses to the Students ’ Conceptions of 
Assessment (SCoA) inventory (Brown, 2003). The questionnaire has 33 items related to four major 
conceptions of assessment (that is, improvement, irrelevance, external, & affect) (items in Appendix 
A). The sixth version of the SCoA structures responses into four 2 nd -order inter-correlated meta¬ 
factors based on a mixture of 1 st -order factors and items (Brown, Irving, Peterson, & Hirschfeld, 

2009; Brown, Peterson, & Irving, 2009). Students responded using a six-point positively packed 
agreement rating scale (that is, two negative and four positive responses). Use of positively packed 
rating scales has been shown to be effective in eliciting variance in responses in social conditions 
when respondents are likely to be positive about all constructs (Brown, 2004a; Klockars & 

Yamagishi, 1988; Lam & Klockars, 1982). 

Since the SCoA had been designed and used with secondary and tertiary students, small scale 
studies were carried out to evaluate the accessibility of the inventory for use with younger students. 

By organising the statements into four prose paragraphs related to the four main factors, it was 
possible to generate readability statistics for the inventory. Just 9% of the sentences were in passive 
voice. The Flesch Reading Ease was 61.6 and the Flesch-Kincaid Grade Level was 6.9, suggesting 
that the inventory should be readily understood by students aged 11 or in Year 6. 

Analysis 

Before any analyses were carried out, missing data were resolved. There were minimal amounts 
of missing data (that is, only 43 missing cells across 33 items and 234 students) which were imputed 
using the expectation maximisation procedure (Dempster, Laird, & Rubin, 1977). Little’s MCAR test 
had x 2 /d/=1.27, p=. 26, indicating that the missing values analysis produced a data set that was not 
statistically different to stalling values for item means, standard deviations, and covariance. 

This study used multi-group invariance testing (Byrne, 1989) to determine whether the existing 
model for the SCoA applied equally to the current sample and to the three groups of participants (that 
is, primary, intermediate, and secondary) within the sample. Equivalence of the configuration of 
pathways (that is, fixed, free, and zero), equivalence of the regression weights and intercepts of items 
at the latent trait factors, and equivalence of inter-factor covariance matrix were sought before factor 
or scale means could be compared (Vandenberg & Lance, 2000). Configural equivalence was 
accepted if the RMSEA index was <.05 and equivalence of regression weights, intercepts, and 
covariance matrices were accepted if the difference in the CFI index was <.01 (Cheung & Rensvold, 
2002). Equivalence was examined only if the model was admissible for all groups (that is, no negative 
error variances and covariance matrix is positive definite) (Gerbing & Anderson, 1987). 

Alternative structures were examined to resolve model inadmissibility, which would be most 
easily attributed to the small sample sizes per group used here, as samples less than 400 are known to 
be less robust in their estimation (Boomsma & Hoogland, 2001). The solution for non-positive 
definite covariance matrices among inter-correlated factors (which is the structure of the SCoA-VI) 
was to introduce a hierarchical super-order factor structure (that is, Conceptions of Assessment) on 
the model, thus retaining the original conceptual meaning of factors and item paths. This revision 
retained the original meaning of the model while generating an admissible and well-fitting solution. In 
accordance with recommendations for small negative error variances, these were corrected to a small 
value above zero (that is, .005) (Chen, Bollen, Paxton, Curran, & Kirby, 2001). 

Once an admissible model was identified and found to adequately fit the data, the equivalence of 
parameters was evaluated with multi-group invariance testing. All model analyses were conducted 
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with AMOS (Arbuckle, 2008) using Pearson product moment correlations; acceptable fit was taken 
when X'/df had p>.05, gamma hat >.90, RMSEA and SRMR <.08 (Fan & Sivo, 2007; Marsh, Hau, & 
Wen, 2004). After demonstrating that the model was invariant across groups within the sample, factor 
mean scores for the contributing groups were contrasted using multiple analysis of variance. 

RESULTS 

The data were fitted to the SCoA-VI model with acceptable fit for three of the fit indices 
(X 2 =954.19, df= 482, y>//=1.98, p=. 16; CFI=.87; gamma hat=.89; RMSEA=.065; SRMR=.069). 
Multi-group confirmatory factor analysis generated a non-positive definite covariance matrix for the 
high school students. To address this problem, a hierarchical 3 ld -order factor was introduced and the 
resulting model was admissible, after constraining to .005 three negative error variances for primary, 
six in intermediate, and four in secondary. The revised model had acceptable fit for the X’/df, gamma 
hat, and RMSEA indices (y;=2756.33, df= 1465, />//=!.88, p=. 17; CFI=.67; gamma hat=.93; 
RMSEA=.062; SRMR=.130). These results gave us sufficient warrant to consider that the four factors 
of the SCoA inventory could be recovered from students in this sample as they had been in previous 
studies. Nevertheless, the following results require corroboration with much larger samples of 
students to ensure that the assumptions concerning the negative error variances are valid. 

Multi-group invariance testing showed that the model was statistically equivalent as parameters 
were progressively constrained: equivalent factor to item regression weights (ACF1=.000), equivalent 
regression weights from higher order factors to lower order factors (ACF1=.002), equivalent structural 
covariances (ACF1=.000), and equivalent structural residuals (ACF1=.007). Flence, the inventory 
elicited responses from students in an identical fashion regardless of their level of schooling. Figure 1 
shows the structure and path values for the constrained equivalent model. 

Mean scores for each of the four conceptions were created by averaging all items contributing to 
the conception. Evaluation of differences in means for the four conceptions was carried out with 
multiple analysis of variance using one factor (that is, school level) with three groups. Each factor had 
statistically different means (Table 2) with small effect sizes (Cohen, 1992). 

Table 2. MANOVA results for four conceptions of assessment and three levels of schooling 


SCoA 

df 

F 

P 

R 2 

/ 

External 

2 

14.486 

.000 

.08 

.09 

Improvement 

2 

28.714 

.000 

.13 

.15 

Irrelevance 

2 

16.015 

.000 

.11 

.12 

Affect 

2 

22.024 

.000 

.11 

.12 


Tukey HSD post-hoc analysis of observed means showed that the secondary group consistently 
was a different subset from the primary and intermediate groups (see Table 3). Secondary students 
gave lower mean scores for ‘external’, ‘improvement’, and ‘affect’, and higher scores for 
‘irrelevance’. There were no statistically significant differences between primary and intermediate 
students, suggesting a major impact on student beliefs may be associated with the transition to 
secondary schooling. It should be noted that the factor means for the high school students were very 
similar (absolute value of Cohen’s d ranged from .05 to .28 indicating trivial to small differences) to 
the means reported from an earlier nationally representative sample of New Zealand high school 
students (Brown, Irving, Peterson, & Hirschfeld, 2009). Hence, insofar as factor means go, it could be 
argued that this sample of high school students reflects the beliefs of the population of New Zealand 
high school students and that these high school students endorsed the four conceptions of assessment 
in a manner quite different from their younger peers. 
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Figure 1 . Student Conceptions of Assessment structure with constrained equivalent parameters across 
three groups. Items are listed in Appendix A. 
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Table 3. Tukey HSD classification of SCoA observed means by level of schooling 


Student Conceptions of Assessment 
External Improve Irrelevance Affect 
Subset Subset Subset Subset 
Level of Schooling A 1 2 1 2 1 212 

3 Secondary 131 3.81 4.14 2.81 2.93 

1 Primary 44 4.34 4.77 2.15 3.71 

2 Intermediate 51 4.55 5.05 2.21 3.99 

P 1.00 .40 1.00 .11 1.00 .92 1.00 .22 

DISCUSSION 

This study was the first using the SCoA inventory with children below the secondary level. 
Results indicated that the inventory elicited responses in a similar fashion to high school age students. 
This supported our first hypothesis that the measurement model of the SCoA would have sufficient fit 
to data so as to explain the responses of the upper primary age students. Further, perhaps because of 
the essentially formative nature of educational assessment in New Zealand and, perhaps because of 
self-regulatory processes, all students, regardless of grade, endorsed most strongly the conception that 
assessment serves to improve student learning, as per our second hypothesis. The results appear to be 
consistent with self-regulation theory. Consistent with a self-regulating approach to assessment, all 
students endorsed most strongly the ‘improvement’ factor and gave less than slight agreement to the 
‘irrelevance’ factor. These mean scores suggested that students considered assessment relevant to 
improved learning, which is an essential component of most self-regulation models (e.g., Zimmerman, 
2008). 

Nonetheless, the experience of being a high school student had a significant impact on the 
conceptions students had of assessment consistent with the studies reviewed above. Clearly, the older 
students, like previous studies with New Zealand students in Grades 9 and 10, had a less ‘formative’ 
or improvement-oriented conception of assessment as they agreed less with the improvement and 
more with the irrelevance conception. Older students also recorded lower agreement with conceptions 
that assessment provides affective benefit, and is external, suggesting less dependence on external 
locus of control in their evaluation of the puipose of assessment. In contrast, the younger students 
endorsed more strongly the formative improvement conception, the positive affective element 
(enjoyment and improved class morale), and the sense that assessment served external purposes, such 
as reporting to parents, predicting future employment, showing intelligence, and evaluating their 
schools. Together, these differences hint that a higher level of self-regulation was apparent among the 
secondary school students because they appeared to be less dependent on the emotional well-being 
effects of assessment and more self-reliance in responding to assessment. Thus, there was evidence to 
support our third and fourth hypotheses that students would respond differently at differing levels of 
schooling; these differences suggest older students are more self-regulating in relation to assessment. 
This is not to suggest that primary students do not attempt to be self-regulating in their assessment 
experiences; it is just that their approach seems more naive and trusting. They seem to expect that, 
like all teaching and learning activities, they will enjoy assessment (i.e., it won’t be negative 
experience) and that it is very much a predictor of their own futures. High school students appear to 
have lost that optimism and perhaps become more realistic about what assessment does. 

Due to the vagaries of convenience sampling and voluntary participation, results by school level 
are confounded by differences in sex, ethnicity, and socio-economic status. Given the extremely small 
sample sizes for these cells, it is not possible to eliminate these confounds in this study. Previous 
studies with version 11 of the SCoA (Hirschfeld & Brown, 2009) showed that there were significant 
differences in how conceptions of assessment related to academic performance according to sex, 
ethnicity, and even grade in high school. Thus, grade differences (that is, high school vs. below high 
school) in this study may reflect sampling differences (that is, sex, ethnicity, and SES) rather than real 
grade differences. This can only be resolved in future studies with more representative sampling. 
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Additionally, students’ differing views within this sample may not be just self-regulating or 
rational adaptations to the higher-stakes consequences of educational assessment in secondary school. 
It is feasible that adolescent developmental processes and related factors (for example, egocentrism, 
increased self-oriented concept of oneself, or identity formation, see Durkin, 1995) are also 
contributing to the changes in the structure of students’ understanding of assessment. 

Another threat to the validity of the findings is the instability of the model estimates in the multi¬ 
group condition. Sample size is the most likely explanation for this instability because the original 
model worked with the combined groups without negative error variances or non-positive definite 
covariance matrix. Ensuring accuracy in estimation can only be resolved in future studies with much 
larger samples for each demographic characteristic of interest. 

Nonetheless, this study is a cross-sectional analysis of different age groups and is confounded by 
the influence of different teachers, schools, socio-economic strata, and ethnicities on student 
conceptions of assessment. Longitudinal tracking of student conceptions of assessment across the high 
school transition is clearly warranted as there is strong evidence that appropriate beliefs about 
assessment contribute significantly to academic performance. Furthermore, the relationship of the 
different conceptions to academic performance for younger students needs to be examined to identify 
potential adaptive and maladaptive effects that may be different from those of older students. 

Hence, this analysis showed that level of schooling may be a significant predictor of student 
conceptions of assessment, with the transition to secondary schooling significantly shaping student 
beliefs within a New Zealand context. Putting aside the differences in sampling which could be 
resolved with larger scale studies, it would appear that the implementation of educational assessment 
in high schools, along with the higher-stakes consequences associated with these practices, may be a 
contributing factor to adolescents having different beliefs from their younger peers. Studies with New 
Zealand and Queensland teachers have shown that high school teachers place more emphasis on 
assessment as student accountability than primary school teachers (Brown, 2011; Brown, Lake, & 
Matters, 2011). This suggests that the introduction of student qualifications or certification 
assessments in high school likely has an impact on the beliefs of both teachers and students. Perhaps, 
the shift in conceptions is a rational response to real changes in how assessment is implemented in 
high schools. The study provides some evidence for the ecological rationality argument about the 
nature of belief systems; students’ beliefs appear to be consistent with the ecological framework of 
assessment purposes and uses in the two different levels of schooling. 

As the potential for negative consequences increases in high school, it is reasonable to expect 
students to become more negative about the role assessment plays in their lives. It is likely that this 
will be more noticeable among lower performing students (Assessment Reform Group. 2002). 

Nonetheless, improvement is still the most strongly endorsed conception of assessment among 
high school students, suggesting that there is still a window of opportunity for teachers. Teachers who 
actively and explicitly use assessment to improve student learning and their own teaching should be 
reassured that this is what all students, including high school students, expect from assessment. 
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APPENDIX A. 

SCoA items 


Code 
COA_acll 
COA_acl2 
COA_acl4 
COA_acl6 
COA_ac5 
COA_ac9 
COA_implO 
COA_impl4 
COA_impl5 
COA_impl6 
COA_impl7 
COA_impl8 
COA_imp21 
COA_imp23 
COA_imp25 
COA_imp26 
COA_imp29 
COA_imp30 
CO A_imp31 
COA_imp32 
COA_imp33 
COA_imp34 
COA_imp9 
COAJrlO 
COA_irl3 
COA_irl4 
COA_ir2 
COA_ir3 
COA_ir5 
COA_ir6 
COA_ir8 
COA_vall 1 
COA_val5 


Item 

Assessment provides information on how well schools are doing 
Assessment is important for my future career or job 

Assessment measures show whether I can analyse and think critically about a topic 
Assessment results show how intelligent I am 

Assessment is checking off my progress against achievement objectives or standards 
Assessment measures the worth or quality of schools 
Assessment is appropriate and beneficial for me 

I look at what I got wrong or did poorly on to guide what I should learn next 
I make use of the feedback I get to improve my learning 

I pay attention to my assessment results in order to focus on what I could do better next time 

I use assessments to identify what I need to study next 

I use assessments to take responsibility for my next learning steps 

My teachers use assessment to help me improve 

Assessment tells my parents how much I've learnt 

Assessment helps teachers track my progress 

Teachers use my assessment results to see what they need to teach me next 

Assessment encourages my class to work together and help each other 

Assessment motivates me and my classmates to help each other 

Our class becomes more supportive when we are assessed 

When we do assessments, there is a good atmosphere in our class 

Assessment makes our class cooperate more with each other 

When we are assessed, our class becomes more motivated to learn 

Assessment is an engaging and enjoyable experience for me 

I ignore assessment information 

Teachers are over-assessing 

Assessment results are not very accurate 

Assessment has little impact on my learning 

Assessment interferes with my learning 

Assessment is unfair to students 

Assessment is value-less 

I ignore or throw away my assessment results 

Assessment results predict my future performance 

Assessment is a way to determine how much I have learned from teaching 
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